eigenvalues from 3x3 matrix